System of automated script generation with integrated video production

ABSTRACT

Disclosed is a method of automated script generation with integrated video production; said method comprising assembling a script comprising a series of steps for a video production; communicating the series of steps of the video production to a central production management application; associating a digital input output device with a video acquisition device; communicating selected ones of the steps in production to said digital input output device; actuating said video acquisition device so as to give effect to said selected ones of said steps; communicating at least video content thus acquired by following said steps to said production management application; integrating said video content thus acquired with content derived by giving effect to others of said steps thereby to produce resultant video output content.Also disclosed is a system of automated script generation with integrated video production; said system including a server; a plurality of content contributors.

TECHNICAL FIELD

The present invention relates to the field of production of video andaudio content and more particularly to the production of video and audiocontent utilising automated assistance.

BACKGROUND

With the prevalence of video enabled cameras, high quality consumervideo recorders and the closing gap between professional quality andconsumer quality video production equipment, more and more users arelooking for ways to produce their own versions of video that capturesimportant events and occasions.

While the equipment enables professional quality recording of video andaudio, the ability to handle the equipment professionally and to scriptand produce professional looking video requires more than goodequipment. Know how is needed.

Another feature of professional quality videos is the ability to captureevents from many different angles involving multiple cameras and oftenmultiple operators.

Generally scripts that outline how an event or occasion should be shotare produced on-the-fly or remain the intellectual property ofprofessional video producers, thereby limiting the opportunity for nonprofessional users to produce good quality video.

Also when a script is produced it often needs to be modified based onthe resources available to shoot the event. For example having twocameras to shoot an event has more limitations than a four camera shootwhere events happen in real time and cannot be staged or reproduced, asin the case of a newly married couple saying “I Do”.

The know how to produce clever, interesting and professional lookingvideo is available but to date it has not been placed in an automatedsystem that allows a script to be generated from a master scripttemplate that takes into consideration the various known factorsinvolved with capturing an important event or occasion and then modifiedfor use with a known number of camera's, operators and other resources.

The described invention is designed to address these issues.

It is an object of the present invention to address or at leastameliorate some of the above disadvantages or provide a usefulalternative.

NOTES

The term “comprising” (and grammatical variations thereof) is used inthis specification in the inclusive sense of “having” or “including”,and not in the exclusive sense of “consisting only of”.

The above discussion of the prior art in the Background of theinvention, is not an admission that any information discussed therein iscitable prior art or part of the common general knowledge of personsskilled in the art in any country.

SUMMARY OF INVENTION

Accordingly, in one broad form of the invention, there is provided asystem of automated script generation with integrated video production;said system including a server; a plurality of content contributors; atleast one activity output device in association with at least onecontent acquisition device.

Preferably the content acquisition device is a video camera.

Preferably the content acquisition device further includes audioacquisition capability.

Preferably the at least one activity output device is integrated withthe at least one content acquisition device.

In yet a further broad form of the invention there is provided a methodof combining preprepared video production content with video contentacquired in real-time; said method comprising storing a selection ofpreprepared video production content on a server; associating a digitalinput output device with a video acquisition device; communicating atleast portions of said preprepared video production content to a centralproduction management application; communicating steps in production tosaid digital input output device; actuating said video acquisitiondevice so as to give effect to at least some of said steps;communicating at least video content thus acquired by following saidsteps to set production management application; combining said videocontent thus acquired with said at least portions of said prepreparedvideo production content thereby to produce resultant video outputcontent.

Preferably only selected ones of said steps are given effect by saidacquisition device.

BRIEF DESCRIPTION OF DRAWINGS

Embodiments of the present invention will now be described withreference to the accompanying drawings wherein:

FIG. 1—Main components of example embodiment

FIG. 2—Main components of Video Processing Server

FIG. 3—Example timeline for a user script

FIG. 4—Example of user interface for script shot and task list.

FIGS. 5A-5F are flow charts illustrating exemplary steps in and in anentire video production sequence.

DESCRIPTION OF EMBODIMENTS First Preferred Embodiment

Disclosed is an example embodiment of a system to allow users to useprofessionally produced scripts for an event or occasion to producetheir own videos. The system includes the ability to define how manycameras and contributing operators are available and support informationto help a producer coordinate and capture the content as per the scriptdirections. The system also assists the producing user in editing andrefining the collected content as per the script outline and publishingit as a finished video production.

FIG. 1 discloses the main components of the example embodiment. Theseinclude a device used by the publisher of the video 10, devices in useby contributing operators and content producers 13 14 15 16. These areall connected over the Internet to a video production server 12, whichmanages content produced by contributor's devices and stores it forfuture compilation according to a script selected by the producing user10.

The devices may be used for content generation, but also may be used bythe users to interact with the video production server. For exampleshots or tasks related to the production schedule as defined by thescript could be communicated and coordinated through an application onthese devices.

FIG. 2 discloses key components of the video production server of theexample embodiment. A central production management application 30 isconnected to a content management system 31 that is in turn connected toand has access to all the content made available or produced for thevideo being produced 32 33 34 35.

A series of professionally written or supplied script templates 37 for awide range of events or occasions, such as but not limited to weddings,anniversaries, graduation or holidays is produced and stored for use bythe users of the system 37. These script templates have been written insuch a way so as to accommodate a wide variety of locations, weather andother factors. They have also been written to accommodate a varyinglevel of access to equipment, operators and operator skill levels.

By becoming a user of the system a producing user can use the scripttemplate of their choice 37 and produce a customized script using theirown additional information 38. By defining the names of contributingoperators, the equipment they have available and their date availabilityas well as other factors such as but not limited to anticipated weatherand location details, the producing user can craft their own scriptusing the script management system 36.

The central production management system 30 uses the script managementsystem 36 and the content management system 31 to manage the process ofhelping a producing user collect, collate and edit content and thenedit, compile and publish the finished result. The main server 30 alsocommunicates with all users by means of the Internet 39 and also usesthe Internet to publish the finished video to a publishing location orsite such as but not limited to YouTube or Vimeo when it is finished.

FIG. 3 discloses a simplified example visualization of a script timeline40 for a wedding. The figure only discloses a small segment of an actualtimeline but is used for illustrative purposes. A vertical line 45denotes a time segregation. In this case, the time before the dottedline 45 denotes an event anytime before the wedding day. The time afterthe time marker 45 denotes events that happen at the beginning of thewedding day.

Layered areas 41 42 43 denote different types of script activities. Forexample area 41 denotes shots or tasks related to interviewing personsrelated to the scripted event. In the example 47, the operator of cameraone has been tasked with contacting the Bride's best friend andinterviewing her about what happened when she told her that she wasgetting married. The event flag 47 is linked to the timeline by means ofa flag marker 46.

The next area 42 related to shots or scenes that do not involve aninterview. In this example shot descriptions and instructions are shownrelating to activities inside the church 48 49 and outside the church asthe Brides Limousine arrives 50.

Each shot or task flag incorporates a delegated operator who isresponsible for collecting the content, a description of what to recordand a context as to when the event should occur. For example theoperator of Camera Two is assigned to capture a close-up of the face ofthe Groom 48 and then to record audio 51 from the audio area of thetimeline 43 to capture the reaction of the Groom as to how he is feelingat that time 51.

The example in this figure is limited to a small segment of time 44 forthe sake of simplicity and clarity.

FIG. 4 gives an example of how a shot and task management applicationrunning on a smart device may look 60. The display 60 shows a list ofshots and tasks 61 62 63 64 65. Each shot or task includes a location,time designator or cue 68 along with a simple summary of the action tobe taken 67. A checkbox 66 along side each shot item or task item allowsthe contributing operator who is using the device to interact with theproducing user and the video production server to volunteer or acceptassignments as part of the script management process.

The described software application interface in FIG. 4 could be used formany other production related purposes but this example is shown toillustrate how an automated script management system could be used tointeract with multiple contributing content producers.

The overall effect of the system is to allow users to systematicallyproduce videos using high quality script templates, a content managementsystem, content contributions from many contributing content producersand an online editing and publishing system to help people make qualityvideo productions of events or occasions that are important to them.

Alternative Embodiments

The example embodiment uses a producing user and four contributingcontent producers to connect to a video production system that usesscript templates and user input to generate a customized script, tomanage the execution of that script, to edit the video and produced afinished video for publishing.

An alternative embodiment could have one or more publishing users, wherenone or more users are contributing content to the system, where theproduction system may be on a user's computer or on multiple computersover a network or over the Internet where application performing varioustasks for the system are shared across multiple computers at differentlocations or where all the services are performed on one computer. Anypart of the production process can be done separately or completed aspart of the same production process.

The example of FIG. 3 is designed to help visualize how a scripttemplate could be converted into a customized script with the additionof specific locations and specific allocation of camera and contributingcontent producers. An alternative embodiment could use any type ofcontent categorization not just limited to the audio, video andinterview categories used in FIG. 3, it could also help visualize anyscript template, with any user modifications for any users using thesystem.

As further shown in FIG. 4 the steps in the process 61, 62, 63, 66 canbe displayed on a digital input output device 80. In a particularpreferred form the digital input output device 80 is associated with avideo camera 81. More preferably the digital input output device isintegrated with the video camera 81. In either instance the digitalinput output device communicates with the central production managementapplication 30 (refer to FIG. 2) so as to receive the steps from thecentral production management application and send the required data inaccordance with the selected steps including video data to the centralproduction management application. In a particular preferred form thedigital input output device 80 utilises a touch sensitive screen inorder to make input more intuitive. In a particular form the digitalinput output device and video camera take the form of a smart phonewhich further includes integrated communication capability to transfervideo content wirelessly to the central production managementapplication.

FIG. 5 is a flow chart illustrating exemplary steps in an entire videoproduction sequence making use of the video content derived frommultiple smartphones whose video content generation is directed andorchestrated according to selected steps derived from the centralproduction management application.

INDUSTRIAL APPLICABILITY

The system according to embodiments of the invention can be implementedutilising a combination of hardware and software. The software portionscan run on servers preferably communicating over the Internet with aplurality of input output devices. In particular forms the input outputdevices comprise video and audio acquisition devices in the form ofvideo cameras and the like.

The invention claimed is:
 1. A system of automated script generationwith integrated video production; said system comprising a videoproduction server comprising an automated script generator and anintegrated video producer, a plurality of content acquisition devices;each of the plurality of content acquisition devices being operable by arespective one of a plurality of operators; at least one of theplurality of content acquisition devices being operable as a productiondevice by the producing user; each of said plurality of contentacquisition devices communicating over the Internet to said videoproduction server; each of said plurality of content acquisition devicesincluding a video acquisition device, audio acquisition capability andan input output device; each of said plurality of content acquisitiondevices being operable in conjunction with the input output device toact as either a content acquisition device or a production device; eachof the plurality of content acquisition devices being configured andarranged to receive the communications generated by the automated scriptgenerator and comprising means by which an operator of the plurality canindicate whether each of the shots or tasks is accepted wherebyrespective operators of the content acquisition devices can receive thecommunications generated by the video production server and cancommunicate to the video production server and advise as to which shotsor tasks the respective operators will accept, and each of the contentacquisition devices comprises an application for facilitatingcommunication and coordination with the video production server suchthat the shots or tasks generated by the video production server can becommunicated and coordinated through the application and displayed oneach of the content acquisition devices.
 2. The system of claim 1wherein the video production server is configured and arranged to storea master script template for capturing an event or occasion by a numberof cameras and operators to make a video production, wherein the masterscript template is written so that the (Master) Script Template iscustomizable with modification of a plurality of factors, including thenumber of cameras, operators capturing the event or occasion, imageanalysis, object detection and classification, activity identification,face detection, emotion/sentiment and voice analysis.
 3. The system ofclaim 1 wherein the server is configured to generate communications,including a script timeline, and a list of shots or tasks, wherein foreach of the shots or tasks the list includes (i) a location, timedesignator or cue; and (ii) a summary of action to be taken.
 4. Thesystem of claim 1, further comprising content acquisition devices,wherein each of the content acquisition devices is a video camera. 5.The system of claim 4, further comprising content acquisition devices,wherein each of the content acquisition devices further includes audioacquisition capability.
 6. The system of claim 1, further comprisingcontent acquisition devices, wherein the content acquisition device isoperable in association with an input output device.
 7. A method ofautomated script generation with integrated video production; saidmethod comprising providing the system of claim 1 and utilizing thesystem to perform the following steps: assembling a script comprising aseries of visual cues and guidelines for the video production from thescript template communicating the series of steps for the videoproduction to a central production management application; communicatingselected of the series of steps to said content acquisition devices;actuating said content acquisition devices so as to give effect to saidselected series of steps; communicating at least video content thusacquired by following said series of steps to said production managementapplication; integrating said video content thus acquired with contentderived by giving effect to others of said series of steps thereby toproduce resultant video output content.
 8. The method of claim 7 whereinsaid a script is assembled comprising a series of steps for theexperience, storytelling and for video production.
 9. The method ofclaim 7 wherein said step of integrating includes one or more ofediting, trimming, adding musical composition or rendering the contentwith postproduction effects.
 10. The system of claim 7, wherein each ofsaid content acquisition devices is used for content generation, and isalso used by users of the system to interact with the video productionserver.
 11. The system of claim 1 wherein the video production server aseries of professionally written, supplied or automatically generatedscript templates for a wide range of events or occasions, such as butnot limited to weddings, anniversaries, graduation or holidays isproduced and stored for use by the users of the system.
 12. The systemof claim 1, further comprising content acquisition devices, wherein eachof the content acquisition devices is a smart device.
 13. The system ofclaim 12, wherein the smart device is a smart phone.
 14. The system ofclaim 12, wherein the smart device is a mixed reality/augmented realtydevice such as smart glasses.
 15. The system of claim 12, wherein thesmart device can indicate whether each of the shots or tasks has beencompleted.
 16. The system of claim 1, further comprising contentacquisition devices, wherein each of the content acquisition devicesaccesses the video production server.
 17. The system of claim 1, furthercomprising content acquisition devices, wherein each of said contentacquisition devices includes a video camera.
 18. The system of claim 1,wherein the video production server is constructed and arrange to enablethe producing user to craft his or her own script timeline using theautomated script generator.
 19. A system of automated script generationwith integrated video production; said system comprising a videoproduction server comprising an automated script generator and anintegrated video producer, wherein the server is configured to enable aproducing user of the system to interact with the video productionserver to customize the video production by (i) modifying the pluralityof factors, including the number of cameras and operators, and (ii)defining names of the operators, equipment availability, date ofequipment availability, anticipated weather conditions, locationdetails, skill of operator, event and a role of operator, the roleselected from a list of possible roles that includes a tour guide and acamera operator.
 20. The system of claim 19, further comprising contentacquisition devices, wherein each of the content acquisition devices isa smart device.
 21. The system of claim 20, wherein the smart device isa smart phone.
 22. The system of claim 20, wherein the smart device is amixed reality/augmented realty device such as smart glasses.